Electronic Device and Method for Manipulating Graphic User Interface Elements

ABSTRACT

An electronic device for manipulating graphical user interface elements has a touch-sensitive display (touch screen) and a touch-sensitive surface (touch pad). The electronic device displays at least two graphical user elements (data icon, program icon, application window, digital photograph, etc.) on the touch screen. A user touches a first element using either the touch screen or the touch pad. This touch user interaction selects the first element and “anchors” it while a user&#39;s slide interaction on the other touch-sensitive surface manipulates the second, non-selected element. The slide contact can be interpreted by the electronic device as a drag, push, rotate, or pixel-based move (e.g., zoom in/out) relative to the first element. Various features of the slide movement, such as the speed, the length, the pressure, the direction, and/or the pattern may affect the manipulation of the second element.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is related to the following U.S. patent application:

-   -   “Method for Implementing Zoom Functionality on a Portable Device        with Opposing Touch Sensitive Surfaces” by Erik Cholewin et al.,        application Ser. No. 12/505,775 filed on Jul. 20, 2009 (Docket        No. CS37015).        The related application is assigned to the assignee of the        present application and is hereby incorporated herein in its        entirety by this reference thereto.

FIELD OF THE DISCLOSURE

The present disclosure relates generally to user interaction with anelectronic device, and more particularly to dual-sided gesturesimplemented using an electronic device that accepts touch input onmultiple sides.

BACKGROUND

Electronic device manufacturers are increasingly using touch-sensitivedisplays (touch screens), which enable a device to visually conveyinformation to a user as well as to enable a user to interactcontextually with displayed graphical user elements and otherwiseprovide user input to the electronic device. Some electronic devicemanufacturers are contemplating devices with a touch pad as well as atouch screen. In one contemplated configuration, a touch sensitivedisplay is placed on an obverse side of a housing of an electronicdevice and a touch pad is placed on a reverse side of the housing. Giventhis contemplated configuration, there are various opportunities todevelop new touch interactions with an electronic device.

The various aspects, features and advantages of the disclosure willbecome more fully apparent to those having ordinary skill in the artupon careful consideration of the following Drawings and accompanyingDetailed Description.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates an obverse side of an electronic device with a touchscreen and a touch pad, and it depicts a user interaction with the touchscreen.

FIG. 2 illustrates a reverse side of the electronic device of FIG. 1,and it depicts a user interaction with the touch pad.

FIG. 3 illustrates the obverse side of the electronic device of FIG. 1after completion of the user interaction with the touch pad, and it alsodepicts a subsequent user interaction with the touch screen.

FIG. 4 illustrates an obverse side of the electronic device of FIG. 1after completion of the subsequent user interaction with the touchscreen.

FIG. 5 illustrates a flow chart for an electronic device manipulatinggraphical user interface elements.

FIG. 6 illustrates a reverse side of an electronic device with a touchscreen and a touch pad, and it depicts a user interaction with the touchpad.

FIG. 7 illustrates an obverse side of the electronic device of FIG. 6,and it depicts a user interaction with the touch screen.

FIG. 8 illustrates an obverse side of the electronic device of FIG. 6after completion of the user interaction with the touch screen.

FIG. 9 illustrates an obverse side of an electronic device with a touchscreen and a touch pad, and it depicts a user interaction with the touchscreen.

FIG. 10 illustrates a reverse side of the electronic device of FIG. 9,and it depicts a user interaction with the touch pad.

FIG. 11 illustrates an obverse side of the electronic device of FIG. 9after completion of the user interaction with the touch pad.

FIG. 12 illustrates a reverse side of an electronic device with a touchscreen and a touch pad, and it depicts a user interaction with the touchpad.

FIG. 13 illustrates an obverse side of the electronic device of FIG. 12,and it depicts a user interaction with the touch screen.

FIG. 14 illustrates an obverse side of the electronic device of FIG. 12after completion of the user interaction with the touch screen.

FIG. 15 illustrates an obverse side of the electronic device of FIG. 12,and it depicts an alternate user interaction with the touch screen.

FIG. 16 illustrates an obverse side of the electronic device of FIG. 12after completion of the alternate user interaction with the touchscreen.

FIG. 17 illustrates an obverse side of an electronic device with a touchscreen and a touch pad, and it depicts a user interaction with the touchscreen.

FIG. 18 illustrates a reverse side of the electronic device of FIG. 17,and it depicts a user interaction with the touch pad.

FIG. 19 illustrates an obverse side of the electronic device of FIG. 17after completion of the user interaction with the touch pad.

FIG. 20 illustrates an obverse side of an electronic device with a touchscreen and a touch pad, and it depicts a user interaction with the touchscreen.

FIG. 21 illustrates a reverse side of the electronic device of FIG. 20,and it depicts a user interaction with the touch pad.

FIG. 22 illustrates an obverse side of the electronic device of FIG. 20after completion of the user interaction with the touch pad.

FIG. 23 illustrates a reverse side of the electronic device of FIG. 20,and it depicts an alternate user interaction with the touch pad.

FIG. 24 illustrates an obverse side of the electronic device of FIG. 20after completion of the alternate user interaction with the touch pad.

FIG. 25 illustrates an obverse side of an electronic device with a touchscreen and a touch pad, and it depicts a user interaction with the touchscreen.

FIG. 26 illustrates a reverse side of the electronic device of FIG. 25,and it depicts a user interaction with the touch pad.

FIG. 27 illustrates an obverse side of the electronic device of FIG. 25after completion of the user interaction with the touch pad.

FIG. 28 illustrates a reverse side of the electronic device of FIG. 25,and it depicts an alternate user interaction with the touch pad.

FIG. 29 illustrates an obverse side of the electronic device of FIG. 25after completion of the alternate user interaction with the touch pad.

FIG. 30 illustrates an obverse side of an electronic device with a touchscreen and a touch pad, and it depicts a user interaction with the touchscreen.

FIG. 31 illustrates a reverse side of the electronic device of FIG. 30,and it depicts a user interaction with the touch pad.

FIG. 32 illustrates an obverse side of the electronic device of FIG. 30after completion of the user interaction with the touch pad.

FIG. 33 illustrates a simplified block diagram of an electronic devicewith a touch screen and a touch pad.

FIGS. 34-35 illustrate various timing options available for userinteraction with the touch screen and the touch pad.

DETAILED DESCRIPTION

An electronic device for manipulating graphical user interface elementshas a touch-sensitive display (touch screen) on an obverse side of theelectronic device and a touch-sensitive surface (touch pad) on a reverseside of the electronic device. The electronic device displays at leasttwo graphical user elements (data icon, program icon, applicationwindow, digital photograph, etc.) on the touch screen. A user touches afirst element using either the touch screen or the touch pad. This touchselects the first element and “anchors” it while a user's slide motionon the other touch-sensitive surface manipulates the second element.

The slide contact sensed on the other touch-sensitive surface can beinterpreted by the electronic device as a drag (lateral movement of thesecond element within the plane of the display screen) relative to thefirst element, a push (virtual movement of the second element in frontor behind the plane of the display screen) relative to the firstelement, a rotate (rotational movement of the second element within theplane of the display screen) relative to the first element, or apixel-based move (zoom in/out or enlarge/reduce) relative to the firstelement.

Various features of the slide movement, such as the speed, the length,the pressure, the direction, and/or the pattern may affect theinterpretation. For example, a rotational slide movement may direct theelectronic device to rotate the second element relative to the firstelement while a linear slide movement may direct the electronic deviceto drag the second element relative to the first element. As anotherexample, sliding to the right may control a zoom out (with the length ofthe slide movement relating to the percentage of zoom out) while slidingto the left may control a zoom in (with the length of the slide movementrelating to the percentage of zoom in).

The touch and slide movements on touch-sensitive surfaces on differentsides of the electronic device are at least partially overlapping intime, with the touch starting prior to or simultaneously with the slide.By supporting dual-sided gestures, the electronic device may enableknown graphical user interface interactions and provide support foradditional graphical user interface interactions.

FIGS. 1-4 illustrate an obverse side 191 and a reverse side 195 of anelectronic device 100 with a touch screen 181 and a touch pad 185. Anobverse side of an object is a side that is primarily intended to beviewed by a user, and the obverse side 191 of the electronic device 100contains the touch screen 181 or other type of touch-sensitive display.The reverse side of an object is a side that is not intended to beprimarily viewed by a user, and the reverse side 195 of the electronicdevice 100 contains a touch pad 185 or other type of touch-sensitivesurface without a display. If desired, the reverse side 195 couldcontain a touch screen instead of the touch pad 185 shown, although theuser is not expected to look at the reverse side when the electronicdevice 100 is subjected to the dual-sided gestures.

The electronic device 100 shown is a portable, handheld electronicdevice such as a mobile phone, remote controller, personal digitalassistant, portable audio or video player, handheld game console, or thelike; however, the electronic device could be implemented as anon-handheld device such as an interactive table-like surface.

The touch screen 181 shows, in this example, six graphical userinterface elements 110, 112, 114, 120, 122, 124. These elements can bedata icons (e.g., file folders, documents, spreadsheets, address bookcontacts, photo files, music files, video files, electronic book files,etc.) to access data, program icons (e.g., word processing,presentation, browser, media player, calendar, geographic navigation,electronic mail or text messaging, electronic games, etc.) to accesssoftware applications, application windows (for individual instances ofopened software applications, file folder navigation, etc.),links/shortcuts to any of the above, and the like. If a user would liketo manipulate one or more of the graphical user elements, the usertouches a first element, using either the touch screen 181 on theobverse side 191 or the touch pad 185 on the reverse side 195, to selecta first element. If a slide contact occurs on the other touch-sensitivesurface, overlapping in time with the touch contact, the electronicdevice 100 will manipulate the other graphical user interface elementsrelative to the first element.

FIG. 1 depicts a user interaction 171 with the touch screen 181. At thispoint in time, the user has touched a first element 120 using the touchscreen 181. In order to provide feedback to the user regarding thetouch-selection of the first element 120, the selected graphical userelement 120 may graphically change properties (e.g., darken, lighten,“blink”, underline, bold, etc.), provide a haptic response (e.g.,vibration, etc.), or the electronic device 100 may provide audiofeedback (e.g., click, tone, or other noise) using an audio speaker 187.A highlighting visual feedback is shown.

FIG. 2 depicts a user interaction 175 with the touch pad 185. Looking atthe reverse side 195 of the electronic device 100, the user slides afinger along the touch pad 185 surface. The slide interaction 175 atleast partially overlaps in time with the touch interaction 171. Afterthe slide interaction 175 begins, the user may release the touchinteraction 171. Alternately, the user may maintain the touchinteraction 171 after the slide interaction 175 begins as shown in FIG.3 via the continued highlighting visual effect. Because the touch pad185 is on the reverse side 195 of the electronic device 100, the slideinteraction 175 is mirrored on the obverse side 191. FIG. 3 illustratesthe obverse side 191 of the electronic device after completion of theslide user interaction 175 with the touch pad 185. Note that thenon-selected graphical user elements 110, 112, 114, 122, 124 have beendragged relative to the selected element 120, and the selected element120 has remained stationary on the touch screen 181. The movement of thenon-selected elements 110, 112, 114, 122, 124 is in accordance (mirrorimage relationship) with the slide interaction 175 on the touch pad 185.Note that some of the non-selected elements 114, 124 have moved off theright edge of the touch screen due to the limited size of the touchscreen 181. A scrolling function (not shown) may be implemented to movethose elements 122, 124 back onto the touch screen 181, perhaps with theside-effect of element 120 moving off the left edge of the touch screen.

FIG. 3 also depicts an optional subsequent user interaction 177 with thetouch screen 181. At this point, a known touch screen interaction isperformed as an extension to the touch interaction 171. For example, theuser moves the former touch interaction 171. The touched element 120follows the subsequent user interaction 177, and FIG. 4 illustrates thetouch screen 181 after completion of the additional user interaction177, when the user is no longer contacting the touch screen 181 or thetouch pad 185. If the touch interaction 171 has been persistentthroughout the slide interaction 175, the subsequent interaction 177 maysimply be a movement on the touch screen 181 after the slide interaction175 has concluded. Alternately, the user could release the touchinteraction 171 after the slide interaction 175 begins, and thesubsequent user interaction 177 could be a separate touch-and-draginteraction.

Although a two-dimensional matrix layout has been shown, the graphicaluser interface screen can be reduced to a one-dimensional matrix layoutsuch as a list of song files, electronic book files, address bookcontact files, etc.

The dual-sided gesture has been illustrated as a single-handed gesture;however, two hands can be used to perform the touch and slide movementsshown. In some electronic device implementations, the electronic device100 as shown is only a portion of a larger electronic device akin to ahinged laptop computer. When the laptop-configured electronic device isin an open position, using two hands to perform the dual-sided gesturemay be ergonomically easier—depending on the size and location of thetouch screen, the size and location of the touch pad, and individualuser preferences.

FIG. 5 illustrates a flow chart 500 for an electronic devicemanipulating graphical user interface elements. The electronic devicehas a touch screen (or other type of touch-sensitive display) andanother touch-sensitive surface (such as a touch pad or a second touchscreen).

Initially, the electronic device displays 510 at least two graphicaluser interface elements on a touch screen. Next, the electronic deviceselects 520 a first element based on a touch contact detected on atouch-sensitive surface. The selection may be indicated to a uservisually or audibly as previously described. After that, the electronicdevice manipulates 530 a non-selected graphical user interface elementbased on a slide contact detected on a different touch-sensitivesurface.

Different types of manipulations are possible depending on theoperational mode of the electronic device, the type of graphical userinterface element selected via the touch contact, the pattern of theslide movement, and other factors. One type of manipulation drags 532the non-selected element with respect to the first element as shown inFIGS. 1-3 and 6-8. Another type of manipulation pushes 534 thenon-selected element with respect to the first element as shown in FIGS.9-16. A third type of manipulation rotates lnposelstart536lnposelend thenon-selected element with respect to the first element as shown in FIGS.17-19. And a fourth type of manipulation moves pixels 538 relative tothe selected element, which is interpreted by the electronic device as aselected pixel. In this manner, zoom in/out or iconenlargement/reduction can be performed as directed by the slide movementas shown in FIGS. 20-29.

The electronic device can optionally cease 540 manipulating based ondetecting cessation of the slide contact. If the touch contact has beenpersistent throughout the slide contact, the electronic device canmanipulate 550 the first element based on movement of the touch contactafter the slide contact ceases.

Although the touch and the slide are performed on differenttouch-sensitive surfaces, the electronic device is agnostic as towhether the touch contact is performed on a touch-sensitive surface onthe obverse side or the reverse side. FIGS. 6-8 show the same userinteraction with the six elements shown in FIGS. 1-3 but starting with atouch on the reverse-side touch-sensitive surface.

FIGS. 6-8 illustrate an obverse side 691 and a reverse side 695 of anelectronic device 600 with a touch screen 681 and a touch pad 685. Onthe obverse side 691, the touch screen 681 displays six graphical userinterface elements 610, 612, 614, 620, 622, 624. Instead of touching thetouch screen 681 to select a first element, a user touches the touch pad685 to select the first element. FIG. 6 depicts a touch user interaction671 with the touch pad 685 to select the first element 620. FIG. 7illustrates the obverse side 691 of the electronic device 600 withselected element 620 highlighted to provide visual indication of thetouch selection from the reverse side 685. Note that the userinteraction 671 on the reverse side 695 results in a mirror imageselection (i.e., element 620 is selected and not element 624). FIG. 7also depicts a slide user interaction 675 with the touch screen 681. Theuser interaction 675 is generally a mirror image of the user interaction175 shown in FIG. 2, because the slide is performed on the obverse side691 touch screen 681 instead of the reverse side 695 touch pad 685. Thenon-selected elements 610, 612, 614, 622, 624 are dragged consistentwith the slide user interaction 675, and the graphical user interface atthe completion of the slide is the same as shown in FIG. 3. FIG. 8illustrates the obverse side 691 of the electronic device 600 aftercompletion of the user interaction 675 with the touch screen 681. Notethat, in FIG. 8, the touch interaction 671 has ceased and thus there isno selected element at this time.

The dragging manipulation of non-selected elements relative to astationary selected element allows a user to move one or more elementswithin the plane of the display screen. A different mode can allow apush manipulation to move non-selected elements virtually in front orbehind a selected element in the plane of the display screen.

FIGS. 9-11 illustrate an obverse side 991 and a reverse side 995 of anelectronic device 900 with a touch screen 981 and a touch pad 985. Onthe obverse side 991, the touch screen 981 displays thirteen graphicaluser interface elements 910, 912, 914, 920,lnposelstartlnplnposelendoselstart922lnposelend, 930, 932, 934, 940,942, 944, 950, 954. These elements are depicted in a virtualthree-dimensional matrix. Thus, some elements seem to be “above” or“below” other elements. In order to select an element that is “on topof” another element, the touch screen 981 on the obverse side 991 may beused for selection. In order to select an element that is “underneath”another element, the touch pad 985 on the reverse side 995 may be usedfor selection.

FIG. 9 depicts a user interaction 971 with the touch screen 981 toselect a first element 932. Feedback for the selection is depicted byhighlighting the first element 932. Note that the touch location of userinteraction 971 is ambiguous and the electronic device 900 defaults tothe element 932 that is virtually closer to the touched side (theobverse side, in this example). If an ambiguous touch occurred (i.e., inthe same location) on the reverse side, the lower element 942 would haveinitially been selected. By making slight finger movements, however, theselection may switch to nearby elements as is known in the art.

FIG. 10 depicts a user interaction 975 with the touch pad 985 on thereverse side 995 of the electronic device 900. The slide userinteraction directs the electronic device 900 to virtually push thenon-selected elements 910, 912, 914, 920, 922, 930, 934, 940, 942, 944,950, 954 “above” the first element 932. FIG. 11 illustrates the obverseside 991 after completion of the user interaction 975 with the touch pad985. Note that the first element 932 is now located “below” the otherelement 942 because all the non-selected elements 910, 912, 914, 920,922, 930, 934, 940, 942, 944, 950, 954 have been moved “up” relative tothe selected element 932. Note also that the touch user interaction 971was released prior to the completion of the push user interaction 975,so no element is highlighted in FIG. 11.

As alluded to previously, using a touch pad on a reverse side of anelectronic device to select an element from the “bottom” of a virtualstack of user interface elements may be easier for a user than trying toselect that same element using a touch screen.

FIGS. 12-16 illustrate an obverse side 1291 and a reverse side 1295 ofan electronic device 1200 with a touch screen 1281 and a touch pad 1285.On the obverse side 1291, the touch screen 1281 displays thirteengraphical user interface elements 1210, 1212, 1214, 1220, 1222, 1230,1232, 1234, 1240, 1242, 1244, 1250, 1254 in a virtual three-dimensionalmatrix similar to FIG. 9. FIG. 12 depicts a user interaction 1271 withthe touch pad 1285. The user touches the touch pad 1285 in a locationthat could be interpreted as a selection of any one of elements 1230,1240, or 1250. Because the touch user interaction 1271 is from thereverse side 1295, however, the electronic device 1200 selects the“lowest” element 1250 of the stack by default. In this example, theelectronic device 1200 provides user feedback regarding the selection byhighlighting the element 1250. Slight finger movement will adjust thedefault selection as desired by the user and should be reflected back tothe user via visual or audible feedback. After the first element 1250 isproperly selected, the user performs a slide user interaction 1275 onthe other touch-sensitive surface. FIG. 13 depicts a slide userinteraction 1275 with the touch screen 1281. This slide user interaction1275 is slight and thus moves the non-selected user elements 1210, 1212,1214, 1220, 1222, 1230, 1232, 1234, 1240, 1242, 1244, 1254 only by onelevel in the virtual three-dimensional matrix. Thus, the first element1250 has moved from “below” the other elements 1230, 1240 in its stackto “between” the other elements 1230, 1240 as shown in FIG. 14.

FIG. 15 depicts an alternate user interaction 1575 with the touch screen1281. In this situation, the same first element 1250 is selected, butthe slide user interaction 1575 is more prominent and thus moves thenon-selected user elements 1210, 1212, 1214, 1220, 1222, 1230, 1232,1234, 1240, 1242, 1244, 1254 two levels down in the virtualthree-dimensional matrix. In this example, the first element 1250 hasmoved from “below” the other elements 1230, 1240 in its stack to “above”the other elements 1230, 1240 as shown in FIG. 16. Although some of thenon-selected elements 1240, 1254 have moved off the bottom edge of thetouch screen 1281 due to the limited size of the touch screen, ascrolling function (not shown) may be implemented to move those elements1240, 1254 back onto the touch screen 1281.

In addition to linear slide movements directing drag and pushinteractions with graphical user interface elements, a circular slidemovement may direct rotate interactions with graphical user interfaceelements. FIGS. 17-19 illustrate an obverse side 1791 and a reverse side1795 of an electronic device 1700 with a touch screen 1781 and a touchpad 1785. FIG. 17 depicts a touch user interaction 1771 with the touchscreen 1781 to select one thumbnail photograph graphical user interfaceelement 1710 out of the two photograph graphical user interface elements1710, 1720 displayed on the touch screen 1781. FIG. 18 depicts a slideuser interaction 1775 with the touch pad 1785 on the reverse side 1795of the electronic device 1700. This clockwise circular slide userinteraction 1775 directs the electronic device 1700 to rotate thenon-selected graphical user interface element 1720 counterclockwise (dueto the mirror image effect of slide user interactions on the reverseside 1795).

FIG. 19 illustrates an obverse side 1791 of the electronic device 1700after completion of the slide user interaction 1775 with the touch pad1785. More degrees in a circular slide user interaction can increase therotation of the non-selected graphical user interface element. Forexample, the 180 degrees of circular slide interaction 1775 showntranslates to 90 degrees of rotation of the non-selected graphical userinterface element 1720. Extrapolating this mapping, 360 degrees ofcircular slide interaction would translate to 180 degrees of rotation ofthe non-selected graphical user interface element, and 540 degrees ofcircular slide interaction would translate to 270 degrees of rotation ofthe non-selected graphical user interface element. Alternately, themapping of the circular slide interaction to rotation of thenon-selected graphical user interface element could be more direct, suchas 180 degrees of circular slide interaction translating to 180 degreesof rotation of the non-selected graphical user interface element.

A slide user interaction on a second touch-sensitive surface can alsodirect a pixel-based move relative to a first element selected using atouch user interaction on a first touch-sensitive surface. This variantmode uses a touch user interaction to select a pixel to “anchor” insteadof a graphical user interface element in its entirety. Pixel-based movesallow a user to direct zoom in/out interactions and enlarge/reduceinteractions.

FIGS. 20-24 illustrate an obverse side 2091 and a reverse side 2095 ofan electronic device 2000 with a touch screen 2081 and a touch pad 2085.On the obverse side 2091, the touch screen 2081 displays a digitalphotograph 2010. FIG. 20 depicts a touch user interaction 2071 with thetouch screen. This touch user interaction 2071 selects a pixel that willbe the central pixel of a zoom in/out function that will be directed bya slide user interaction 2075, 2375 on a touch pad 2085 on the reverseside 2095 of the electronic device 2000.

FIG. 21 depicts a slide user interaction 2075 with the touch pad 2085.This slide interaction 2075 directs the processor of the electronicdevice 2000 to zoom in the digital photograph 2010. The direction,speed, pressure, and/or length of the slide may direct the enlargementvalue of the zoom function. In this example, sliding to the left (asshown in FIG. 21) directs a zoom in as shown in FIG. 22. Meanwhile,sliding to the right (as shown in FIG. 23) directs a zoom out as shownin FIG. 24.

FIGS. 25-29 illustrate an obverse side 2591 and a reverse side 2595 ofan electronic device 2500 with a touch screen 2581 and a touch pad 2585.In this example, a slide user interaction 2575, 2875 directs anenlargement or a reduction of a non-selected icon 2210. FIG. 25 depictsa user interaction 2571, 2572 with the touch screen 2581 that selectstwo interactive user elements 2220, 2230 from the three interactive userelements 2210, 2220, 2230 displayed. Note that in this case, the touchuser interaction 2571, 2572 is a dual-touch user interaction and the twouser elements could also be considered a two-part selected firstelement.

FIG. 26 depicts a slide user interaction 2575 with the touch pad 2585 onthe reverse side 2595 of the electronic device 2500. In this mode, theslide user interaction 2575 enlarges the non-selected interactive userelement 2210 as shown. The slide speed, direction, pressure, and/orlength may determine the degree of enlargement implemented by theprocessor of the electronic device 2500 as shown in FIG. 27.

FIG. 28 depicts an alternate user interaction 2875 with the touch pad2585. In this example, a slide in the “up” direction directs anenlargement and a slide in the “down” direction” directs a reduction.FIG. 29 illustrates an obverse side 2591 of the electronic device 2500after completion of the alternate user interaction 2875 with the touchpad 2585.

More complicated slide user interactions may be implemented on anelectronic device. FIGS. 30-32 illustrate an obverse side 3091 and areverse side 3095 of an electronic device 3000 with a touch screen 3081and a touch pad 3085. In this example, instead of a linear slide gesturedirecting movement of non-selected elements as shown in FIGS. 1-3, 6-16,and 20-29 or a circular slide gesture as shown in FIGS. 17-19, FIG. 31depicts an angled slide user interaction 3075. FIG. 30 depicts a userinteraction 3071, 3072 with two interactive user elements 3010, 3020displayed on the touch screen 3081. This dual-touch user interaction3071, 3072 anchors both elements 3010, 3020 (i.e., a dual-part selectedelement) such that a subsequent slide interaction does not move theanchored elements 3010, 3020.

FIG. 31 depicts a slide user interaction 3075 with the touch pad 3085 onthe reverse side 3095 of the electronic device 3000. This slideinteraction 3075 is angled with an “up” portion followed by a “right”portion. Such a dual-slide user interaction may be helpful to preventunintended adjustment of interactive user interface elements due toinadvertent contact with the electronic device's touch-sensitivesurfaces. As shown in FIG. 32, the dual-slide user interaction 3075directs the non-selected element 3030 to move left (due to the mirroreffect of the slide on the reverse side 3095). The “up” portion of theslide interaction 3075 does not direct a drag of the non-selectedelement 3030 but rather complicates the slide user interaction such thatinadvertent drags are less likely to occur.

FIG. 33 illustrates a simplified block diagram of an electronic device3300 with a touch screen 3381 and a touch pad 3385. As shown, the touchscreen 3381 is on an obverse side of the electronic device 3300 and thetouch pad 3385 is on a reverse side of the electronic device 3300. Inother embodiments, however, the touch pad could be on the top of theelectronic device, the bottom of the electronic device, or even on theobverse side of the electronic device along with the touch screen 3381.As noted previously, the touch screen 3381 and touch pad 3385 areexamples of touch-sensitive surfaces, and the touch pad 3385 can bereplaced with a second touch screen in an alternate embodiment. Theelectronic device 3300 also has a touch screen controller 3382 coupledto the touch screen 3381 and a touch pad controller 3386 coupled to thetouch pad 3385. Both controllers 3382, 3386 are coupled to a processor3388. In other embodiments, the controllers may be integrated into asingle controller or into the processor 3388. The processor 3388receives signals from the touch screen 3381 and touch pad 3385 via theirrespective controllers 3382, 3386 and directs signals to the touchscreen 3381 display (via its controller 3382) and/or audio speaker 3387.

A memory 3389, coupled to the processor 3388, stores software programsfor manipulating graphical user interface elements in accordance withthe flow diagram of FIG. 5, an operating system, various applicationprograms, and data files. The memory 3389 can include one or more formsof volatile and/or non-volatile, fixed and/or removable memory, such asread-only memory (ROM), electronic programmable read-only memory(EPROM), random access memory (RAM), and erasable electronicprogrammable read-only memory (EEPROM).

When executing various software programs, the processor 3388 has a touchdetection module 3371 for detecting a touch user interaction on a firsttouch-sensitive surface of an electronic device 3300. The detectionmodule determines which graphical user interface element has beenselected via the detected touch. A slide detection module 3375 detects aslide user interaction on a second touch-sensitive surface of theelectronic device 3300. Based on the detected slide motion (possiblyincluding pressure, velocity, direction, and pattern of the slidemotion), a graphical user interface element manipulation module 3376manipulates non-selected interactive user elements relative to the firstinteraction user element(s) based on the slide user interaction. Asmentioned previously, the manipulation may be classified as drag, push,rotate, or pixel-based moves based on the slide user interaction.Signals from the manipulation module are coupled to the display screencontroller 3382 to cause the graphical user interface elements to changeas directed by the processor 3388.

The electronic device 3300 can also include a variety of othercomponents (not shown) based on the particular implementation. Forexample, if the electronic device 3300 was implemented as a mobilephone, it would also include a microphone and a wireless transceiver andpossibly additional input components such as a keypad, accelerometer,and vibration alert. If the electronic device 3300 was implemented as aremote controller, an infrared transmitter could also be included.

FIGS. 34-35 illustrate various timing options available for userinteraction with the touch screen and the touch pad. In FIG. 34, a touchuser interaction 3410 occurs on a first touch-sensitive surface of anelectronic device. This touch user interaction 3410 has a positive timeduration as shown. After starting the touch user interaction 3410 andbefore ending the touch user interaction 3410, a slide user interaction3420 occurs on a second touch-sensitive surface of the electronicdevice. The time elapsedlnposelstartlnpolnposelendselstart3450lnposelend between thecommencement of the touch user interaction 3410 and the commencement ofthe slide user interaction 3420 may be any positive value time period,including a zero time elapsed—which means that the touch interaction3410 and the slide interaction 3420 commenced at almost the same time.(The tolerance for a “zero time elapsed” determination may be set by amanufacturer setting, a user-configurable setting, or through a learningprocess by the electronic device.)

The touch interaction 3410 and the slide interaction 3420 both continuefor a period of time 3460, and it is generally expected that a user willrelease the touch interaction 3410 before completing the slideinteraction 3420 as shown in FIG. 34, resulting in a time period 3470where the electronic device only detects the slide interaction 3420.FIGS. 6-32 all presume the kind of timing depicted in FIG. 34. The touchuser interaction 3410 on a first touch-sensitive surface selects aninteractive user element (or pixel) on a display of the electronicdevice while the slide user interaction 3420 on a second touch-sensitivesurface manipulates other interactive user elements on the display.

FIG. 35 illustrates an alternate timing option where the touch userinteraction 3510 starts before and ends after a slide user interaction3520. This situation occurs in FIGS. 1-4 described earlier. Thus, thereis a time period 3550 between starting the touch user interaction 3510and starting the slide user interaction 3520, a time period 3560 whenthe electronic device detects both the touch user interaction 3510 andthe slide user interaction 3520, followed by a time period 3580 afterthe slide interaction 3520 completes where the touch interaction 3510remains. In this time period 3580, the touch user interaction 3510 couldchange to become a drag user interaction (or other type of touch-baseduser interaction) as shown in FIG. 3.

Thus, the electronic device and method for manipulating graphical userinterface elements detects a touch user interaction on a firsttouch-sensitive surface of an electronic device to select a firstinteractive user element, detects a slide user interaction on a secondtouch-sensitive surface of the electronic device, and manipulatesnon-selected interactive user elements relative to the first interactionuser elements based on the slide user interaction. This document hasdisclosed drag, push, rotate, and pixel-based moves based on the slideuser interaction.

While the present invention is susceptible of embodiment in variousforms, the drawings show and the text describes embodiments with theunderstanding that the present disclosure is to be considered anexemplification of the invention and is not intended to limit theinvention to the specific embodiments illustrated. Furthermore, whilethe various figures are intended to illustrate the various claimedaspects of the present invention, in doing so, the elements are notnecessarily intended to be drawn to scale. In other words, the size,shape, and dimensions of some elements, features, components, and/orregions are for purposes of clarity (or for purposes of betterdescribing or illustrating the concepts intended to be conveyed) and maybe exaggerated and/or emphasized relative to other illustrated elements.

While various embodiments of the invention have been illustrated anddescribed, it is to be understood that the invention is not so limited.Numerous modifications, changes, variations, substitutions, andequivalents will occur to those skilled in the art without departingfrom the spirit and scope of the present invention as defined by theappended claims.

1. A method for manipulating graphical user interface elementscomprising: displaying at least two elements on a touch screen of anelectronic device; selecting a first element based on a touch contactdetected on a first side of the electronic device; manipulating a secondelement based on a slide contact detected on a second side of theelectronic device.
 2. A method in accordance with claim 1, wherein themanipulating comprises: dragging the second element relative to thefirst element.
 3. A method in accordance with claim 1, wherein themanipulating comprises: pushing the second element relative to the firstelement.
 4. A method in accordance with claim 1, wherein themanipulating comprises: rotating the second element relative to thefirst element.
 5. A method in accordance with claim 1, wherein the firstelement is a first pixel and the second element is a second pixel andthe manipulating comprises: moving the second pixel relative to thefirst pixel.
 6. A method in accordance with claim 1, further comprising:ceasing the manipulating based on detecting cessation of the slidecontact.
 7. A method in accordance with claim 6, further comprising:manipulating the first element based on movement of the touch contact.8. A method in accordance with claim 1, further comprising: detecting aspeed of the slide contact; and performing the manipulating based on thespeed.
 9. A method in accordance with claim 1, further comprising:detecting a length of the slide contact; and performing the manipulatingbased on the length.
 10. A method in accordance with claim 1, furthercomprising: detecting a pressure of the slide contact; and performingthe manipulating based on the pressure.
 11. A method in accordance withclaim 1, further comprising: detecting a direction of the slide contact;and performing the manipulating based on the direction.
 12. A method inaccordance with claim 1, further comprising: detecting a pattern of theslide contact; and performing the manipulating based on the pattern. 13.A method in accordance with claim 1 wherein the touch contact and theslide contact at least partially overlap in time.
 14. A method inaccordance with claim 13 wherein the touch contact begins prior to theslide contact beginning.
 15. A method in accordance with claim 1 whereinthe selecting comprises: selecting a two-part first element based on adual-touch contact.
 16. A method in accordance with claim 1 wherein theselecting comprises: graphically changing properties of the firstelement.
 17. A method in accordance with claim 1 wherein the selectingcomprises: creating an audible signal.
 18. An electronic devicecomprising: a touch-sensitive display for displaying at least twographical user interface elements; a touch-sensitive surface; aprocessor, coupled to the touch-sensitive display and thetouch-sensitive surface including: a touch detection module fordetecting a touch user interaction on the touch-sensitive display or thetouch-sensitive surface and for selecting a first graphical userinterface element; a slide detection module for detecting a slide userinteraction on the touch-sensitive display or the touch-sensitivesurface; and a manipulation module for manipulating a second graphicaluser interface element based on the slide user interaction.
 19. Anelectronic device in accordance with claim 18, wherein thetouch-sensitive display is positioned on an obverse side of theelectronic device.
 20. An electronic device in accordance with claim 18,wherein the touch-sensitive surface is positioned on a reverse side ofthe electronic device.